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Low  frequency  1/f  noise  limits  the  ultimate  sensitivity  of  semiconductor  de- 
vices such  as  MOSFET  (M0S  Field-Effect-Transistor)  and  CCD  (Charge  Coupled  De- 
vices). The  study  of  the  origin  of  the  low  frequency  noise  sources  requires  de-‘ 
tailed  measurements  of  the  noise  power  spectra  under  a wide  range  of  device 
operating  conditions.  This  report  details  the  design  and  operation  of  a hard- 
wired noise  correlation  processor  (correlator)  which  is  interfaced  to  a host 
computer  for  two-way  handshaking  operation.  The  correlator  samples  che  noise 
voltage  from  a device  under  study  as  well  as  calculates,  averages  and  stores  the 
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20.  ABSTRACT 

autocorrelation  function  of  the  noise.  The  host  computer  can  then  sample  the 
autocorrelation  data,  calculate  the  power  spectrum  and  plot  the  results,  all 
on  a low  priority  time  sharing  basis  if  necessary.  This  system  provides  the 
flexibility  of  programmable  control  and  the  speed  and  accuracy  of  dedicated 
hardware  correlator.  In  order  to  optimize  the  correlator  design,  a detailed 
analysis  of  sampling,  correlation  and  noise  theory  were  undertaken  which  pro- 
vided some  important  insights  on  sampling  quantization  errors,  and  noise  power 
averaging  techniques  using  incomplete  correlation.  These  theoretical  concepts 
apply  to  a wide  range  of  situations  of  signal  correlation,  as  well  as  noise 
power  spectra  measurements  on  silicon  semiconductor  devices. 
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SUMMARY 


Low  frequency  1,  t noise  limits  the  ultimate  sensitivity  oi  semicon- 
ductor devices  such  as  MOSFET  tMOS  Field-Ef  tec  t-l'rans  is  t or ' and  CCD  vCharge 
Coupled  Devices'.  The  study  or  the  origin  ot  the  low  frequency  noise  sources 
requires  detailed  measurements  ot  the  noise  power  spectra  under  a w ide  range 
of  device  operating  conditions.  This  report  details  the  design  and  operation 
or  a hardwired  noise  correlation  processor  f correlator)  which  is  interfaced 
to  a host  computer  for  two-wav  handshaking  operation.  The  correlator  samples 
the  noise  voltage  from  a device  under  study  as  well  as  calculates,  averages 
and  stores  the  autocorrelat ion  function  of  the  noise.  The  host  computer  can 


then  sample  the  autocorrelation  da ta , calculate  the  power  spectrum  md  plot 


the  results,  all  on  a Low  priority  time  sharing  basis  if  necessary.  This 
system  provides  the  flexibility  or  programmable  control  and  the  speed  and 
accuracy  or  dedicated  hardware  correlator.  In  order  to  optimize  the  correla- 
tor design,  -i  detailed  analysis  of  sampling,  correlation  and  noise  theory 
were  undertaken  which  provided  some  important  insights  on  sampling  quantiza- 
tion errors,  and  noise  power  averaging  techniques  using  incomplete  correla- 
tion. These  theoretical  concepts  apply  to  a wide  range  of  situations  or 
signal  correlation,  as  well  as  noise  power  spectra  measurements  on  silicon 
semiconductor  devices. 
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DESIGN , ERROR  ANALYSIS  AND  OPERA  HON  OP 


A NOISE  AUTOCORRELATOR 


I.  INTRODUCTION 

In  the  research  on  the  mechanisms  of  noise  generation  in  solid  state 
devices,  the  most  time-consuming  and  tedious  task  is  probably  the  manual  ex- 
perimental measurement  of  the  noise  power  spectra,  especially  at  low  frequen- 
cies such  as  1 or  10  He.  Brute  force  approach  for  manual  narrow  band  noise 
measurements  is  very  time-consuming  since  meaningful  results  can  be  obtained 
only  after  averaging  over  a time  interval  substantially  larger  than  the  re- 
ciprocal bandwidth. 

This  report  presents  a theoretical  analysis,  design,  and  experimental 
implementation  as  well  as  operation  of  a computer-controlled  automatic  noise 
data  acquisition  system.  The  stored  noise  data  in  the  computer  memory  can  be 
analyzed  further  and  presented  in  tabulated  and  graphic  forms. 

In  designing  a noise  autocorrelator , it  is  important  to  study  trade- 
offs among  hardware  cost , speed,  and  accuracv.  Some  of  the  subjects  covered 
in  this  report  are  generally  applicable  to  ail  types  of  input  signals  for  both, 
hardware  and  software  correlators.  However,  we  are  interested  rrimariiv  in 


ment.  We  will  find  that  some  of  the  design  parameters  are  surprisingly  non- 
criticai,  whereas  others  are  extremely  limiting.  3v  examining  the  errors  duo 
to  all  the  parameters,  the  most  efficient  combination  can  be  put  together. 

Very  early,  however,  the  decision  was  made  to  use  digital  rather  than  analog 
computation  due  to  the  inherent  advantages  in  the  frequency  and  dynamic  range. 

In  the  second  chapter,  the  basic  concepts  of  the  Nyquist  theorem, 
the  autocorrelation  function,  and  the  wiener-xhintchine  theorem  ar-'  briefly 


1, 


discussed  along  with  mention  of  analog-digital  conversion  errors.  The  third 
chapter  investigates  the  sampling  time  required  to  obtain  a good  average  of 
each  of  the  noise  signal's  spectral  components.  This  information  is  used  in 
chapter  tour  to  choose  between  hardware  and  software  correlation  and  between 
complete  and  incomplete  data  analysis  schemes.  The  manv  samples,  shown  to 
be  necessary  by  the  analysis,  allow  the  use  of  large  input  quantization  errors 
while  maintaining  output  accuracy,  and  determine  the  relative  unimportance  of 
the  error  due  to  a finite  number  of  samples.  This  is  discussed  in  chapter 
five,  finally,  operation  of  the  correlator  is  discussed  in  chapter  six  and  is 
illustrated  with  sample  correlator  outputs  and  computer  printouts. 


II.  SAMPLING  THEOREMS 

The  modern  sampling  theorem  is  generally  credited  to  Nyquist"  and 
has  been  extended  by  Shannon*-.  This  sampling  or  Nyquist  theorem  states  that 
a function  limited  to  frequencies  where  j f | *- f q can  be  perfectly  reproduced  by 
sampling  isolated  points  at  a fixed  frequency  of  Ofj  or  greater.  This  theorem 
is  somewhat  idealized,  however,  and,  in  practice,  errors  are  always  present 
due  to  high  frequency  aliasing,  limited  frequency  resolution,  and  finite 


sampling  windows. 

Sampling  a time  function  at  a fixed  frequency,  Of o * is  equivalent 
mathematically  to  multiplication  of  the  function  by  an  impulse  train  or  convo- 
lution of  the  frequency  spectrum  by  an  impulse  train.  This  results  in  repro- 
ducing the  frequency  spectrum  at  intervals  of  Of  ^ . As  long  as  the  spectrum  is 
exactly  zero  for  if|*fo,  there  is  no  overlap  of  the  adjacent  identical  frequen 
cy  spectra,  and  the  original  spectrum  can  be  obtained  by  running  the  signal 
through  a low  pass  filter  or  simply  ignoring  the  f'fj  components  of  the  total 
. This  is  depicted  graphically  in  Figures  1(d)  and  Ivb^. 


:aicuiated  spectrum 


However,  the  Fa  ley -wiener  theorem"  states  that  exact  iv  sand  limited 


r Liters  are  ohvsicallv  unrea 1 Lcnblo , a:.d  our  original  wideband  •. 


C . U>  e .....  V.  v . v 


must  have  some  components  in  the  range  o:  mm.  This  means  that  adjacent 
identical  frequency  spectra  do  overlap,  so  a higher  frequency  component  at 
r’o  + f will  appear  to  he  a spectral  component  at  fp-f.  Th.is  raise  appearance 
is  called  "aliasing."  This  error  is  normally  minimised  cy  using  good  filters 
and  choosing  a sampling  frequency  somewhat  larger  than  the  theoretical  mini- 
mum. We  will  use  an  additional  racto"  of  ten  so  that  the  sampling  frequency 
is  OOfj.  This  will  give  negligible  aliasing  error  with  only  simple  filters. 
Also,  because  of  an  additional  restraint  on  the  autocorrelation  function 
resolution  due  to  the  numerical  integration  we  will  use  to  obtain  the  spectrum, 
the  sampling  frequency  is  higher  than  is  necessary  to  mere Iv  limit  the  "ali- 
asing" error. 

The  Nyquist  theorem  assumes  an  in.rinite  number  of  samples,  and,  of 
course,  we  are  limited  to  a finite  sampling  time.  This  corresponds  mathemati- 
cally to  multiplying  the  impulse  train  in  time  bv  a box  function  or  length, 
or  co nvolucing  the  frequency  spectrum  with  the  transform  or  the  box , v.sir.m 
if.  These  functions  are  indicated  in  figure  Ivc'.  \s  long  as  the  frecuencv 


spectrum  is  fairly  constant  over  intervals  : o-  m .ess.  the  vsir.rf- 


tion  can  be  approximated  by  an  impulse,  and  the  oor.vo  but  ion  does  not  ohan.ge 
the  spectrum.  Thus,  the  minimum  frequence  resolution  is  u.  because  this  func- 
tion smears  out  or  averages  over  that  trecuenov  interval. 


. tna^uv,  tn.ere  is  error  assov-.atod 
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required  to  obtain  a point  sample  due  to  me  fluctuation  over  that  time 
This  time  is  associated  with  the  particular  sample-nold  or  analog-digital  v A-0 
converter  device  emp loved.  We  require  a OOdxhr.  maximum  sampling  frequency 


corresponding  to  a 10 KHc  maximum  signal  frequency  ir.d  propose  using  an  A-f 


converter'  with  a 2 us  conversion  time  tor  the  four  bits  we  will  nee*!.  This 
provides  a factor  of  50  between  the  nominal  maximum  frequency  and  the  conver- 
sion frequency.  Also,  the  full  scale  fluctuation  must  be  allocated  for  in  a 
wideband  noise  signal,  and  the  very  highest  frequency  components  alone  would 
not  be  expected  to  have  anything  close  to  full  scale  amplitudes.  We  will  find 
that  the  individual  sampled  point  quantization  error  due  to  the  sma. 1 number 
of  bits  used  will  be  much  larger  than  the  A-D  conversion  time  error. 

In  order  to  calculate  the  frequency  spectrum,  S(f)  of  a time  func- 
tion, v(t),  it  is  first  desirable  to  calculate  the  autocorrelation  function 
given  by 

iKt)  = v(tWt+r)  (1) 


where  x is  the  delay  time  in  integer  multiples  of  the  sampling  period.  Then 
the  frequency  spectrum  is  obtained  through  the  Wiener-Khintcnine  integral, 


S(w ) 


4 


if  ( r )cosi»rdr 

0 


(2) 


There  is  also  an  inverse  integral  fox'  the  autocorrelation  function  given  by 


b(  t ) 


r 

Sl  to)coswrdii) 

0 


(3) 


The  correlator  has  the  job  of  sampling  at  high  speed,  calculating  the  auto- 
correlation function,  and  storing  it  for  introduction  into  a software  inte- 
gration program  or  a Courier  analyzer. 

The  numerical  integration  can  take  significant  time,  so  the  choice 
of  procedure  used  is  critical.  In  particular,  an  appropriate  range  of  ;re- 
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quency  must  be  chosen.  It  -ingle  lee  i I.;  frequency  spectr t are  desired,  t J00 
point  lutocorrelut ion  function  must  be  calculated.  1'his  is  because  wo  need  j 
sampling  rate  .'0  times  the  highest  frequency,  -is  -lisoussed  before , and  a total 
sample  time  equal  to  the  period  ot  the  lowest  frequency  to  insure  good  frequency 
resolution.  A two-decade  spectrum  can  be  obtained  in  one  ot  two  ways.  First, 
two  single-decade  spectra  can  be  patched  together.  This  requires  twice  the 
integration  time  and,  if  a higher  frequency  decade  is  added,  10%  more  correla- 
t ion  time.  The  other  alternative  is  a continuous  two-decade  spectrum.  How- 
ever, this  requires  a 0000  point  autocorrelation  function,  increasing  the 
required  integration  time  and  the  storage  capacity  by  a factor  of  10.  It  does 
eliminate  the  10%  increase  in  correlation  time,  since  the  additional  points 
-ire  obtained  by  increasing  the  sample  rate  rather  than  the  tot-il  time,  but 
this  does  not  offset  the  other  problems.  Anything  less  than  one  decade , how- 
ever'. obviously  does  not  experience  this  order  of  magnitude  gain  in  time  and 
memory,  so  one  decade  seems  to  bo  the  choice. 

In  anv  calculation  based  on  experimental  results,  there  is  error 
associated  with  the  finite  limits  ot  the  Wiener-kh intchine  integrals.  For 
example,  it  we  have  a noise  spectrum  th.it  is  flat  between  and  -i- , i.e. 

Fro''  l,  and  .-ero  elsewhere,  r he  lutocorre  ’-at  ion  t mvt  ion  from  liquation  v A ' is 

■ft  t ' - ' Sf -o )eos.ii r du> 

- I , - • . - 

- — r iinio,  t -s  inui,  t ’ t -t ' 

. n l 1 

The  calculated  power  spectrum,  g'wf  is  then 


-i'- 
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where 


S'Ij)  : 4 


( s i Hu)  > r — j ; [Vo  i r )casuii  dr 

’ni  • 1 
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(5) 


siu)  = ! iiiU-at 


(6) 


In  a typical  case,  ~4-  is  one-half  the  lowest  frequency  in  the  one- 

*:  7T 

decade  spectrum  of  interest  and  4~  is  twice  the  highest  frequency.  This  is 
an  approximation,  since  the  filter  rolloff  is  sharp  but  finite.  If  we  assume 


from  our  previous  analyses,  that  t 


2Uq  2jt  ) 


, then  we  have 


u)  l r = i 
1 m 
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m t 
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The  function  8ir.x)  can  be  closely  approximated  by 


S L r x ) 


f(x)cosfx)  - g(x)sin(x) 


18) 


where,  for  x'i,  we  have 


fix) 


g t,  x ' 
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X“ 


fix' 


l,  0 ) 
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Because  is  so  Large,  the  first  two  terms  in  the  expression  for 

S'(w)  can  be  approximated  by  so  that  we  get 


S'U)  = 


lr  U TT  TT 

* I - 2 * 


:os(u)+u)i  )t  cos ( i ) t 

m tt_  1 m 
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where'we  used  Si(x)  = -3i(-x)  in  the  last  term.  Obviously  the  assumed  spec- 
trum is  recovered  in  the  first  term,  but  there  is  an  error  given  by  the  second 
and  third  terms. 

A similar  calculation  for  S(w)  = — gives 

U) 


. , COS  ( U)+0J  j ) T 

S'(uj)  = -{1  - — [2sin(u)i  )Ci(u)ir  ) + — 

^ 11  mm  (uh-u)  j ) x 
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where 


Ci(x)  = ! SSlill 


dt 


(12) 


We  can  make  CKujjt^)  zero  by  appropriate  choice  of  <o ^ (e.g.  “)irm=  3.4),  giving 
an  error  result  very  similar  to  Equation  (10), 


, . cos(<i>+toi  )t  cos(w-(oi  )t 

S'U)  = kl  - i \ — — + L-2L]  (13) 

U)  TT  (<*)+(*>!  )t  )r  v 
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The  actual  eurot'  is  dependent  on  uij  and  also  on  the  exact  form 
or  the  filtering  at  -u  which  has  been  idealised  in  the  above  calculation. 
However,  tor  j , t = J.;*  which  corresponds  to  a minimum  cutoff  frequency  of  0.-»l 
times  the  lowest  frequency  in  the  calculated  spectrum,  the  error  is  about  3i> 
maximum  for  the  assumed  flat  spectrum  and  about  7%  maximum  for  the  assumed  1/f 
spectrum.  This  value  of  f[  is  reasonable  from  the  standpoint  of  eliminating 
unwanted  frequencies  without  altering  the  desired  spectral  components. 

The  theoretical  calculation  is  useful  for  obtaining  the  gross  fea- 
tures of  this  error,  but,  because  of  the  ideal  spectra  that  were  assumed,  it 
is  doubtful  that  the  calculation  can  be  used  to  subtract  out  the  error.  The 

best  way  to  eliminate  it  is  to  simply  average  over  Aw=t—  and  smooth  the  cai- 
rn 

ciliated  spectrum.  This  point  illustrates  the  true  nature  of  this  error.  It 

is  the  frequency  resolution  error  in  the  Wiener-Khintchine  integral  predicted 

by  the  Nvquist  theorem  due  to  the  finite  sampling  time,  t . If  t the 

m m 

error  is  oero  for  all  spectra.  It  is  true  that  the  error  is  also  aero  for 
^,=0  in  the  flat  spectrum  LEduatton  (10)],  but  the  concept  of  frequency  reso- 
lution is  irrelevant  if  there  is  no  structure  in  the  spectrum. 


III.  NOISE  SAMPLE  TIME 

The  magnitude  of  a particular  frequency  component  in  a noise  signal 

will  vary  statistically  in  time.  Therefore,  it  is  important  to  know  how  long 

• ^ 
the  signal  must  be  sampled  in  order  to  obtain  a good  average.  Van  der  die! 

has  derived  this  result  for  an  RC  filter  of  time  oonstant,  T,  and  found  the 

relative  accuracy  to  be  1//2BT  for  a bandwidth,  B,  in  the  signal.  We  will 


follow  his  derivation  but  modify  it  to  our  sampling  technique. 


-■)- 


Let  xtt)  be  the  random  input  to  a quadratic  detector  with  a current 


output  of  I = x‘ . We  want  to  average  long  enough  tv)  get  I.  '.'he  autooorrelat ion 
of  the  error  is  [ Ut)-T][Ilt  + i >-T.].  Van  der  «iel  * shows  that 


[ I(t  )-I ][  U ttt  )-I  J = 2l=c‘U) 


where  oft ) is  the  normalized  autocorrelation  function  of  xtt)  given  b; 


:( r ) = x(!  t !)x(  t+r )/  x* 


The  spectral  intensity  of  the  error  is  given  by  the  Wiener-rdiintchine 
integral  ot  equation  tl),  namely 


S(o)  = ’»  ! LUt)-I]Ll(t+T  )-I  koswrdr 


= 4 ' 21-c*- f r )ooswrdt 


The  autocorrelat ion  function  of  a square  band  ot  intensity,  . bandwidth,  8, 
and  center  frequency,  fj , is  given  by  the  inverse  Wiener- Khintchine  integral 


l I 

t—  ! S'  (m)cos<ordui 

> ' Jo 


-fotb...' 

>0  I cou.brfdf 


- So  is  inn  Hr  Hcos.'nf  o t ^ n 3 t 


cU  ) = c ' l r )/S0B 


= (sinnBx  )(cos2nt'oT  )/nBr 


as) 


Inserting  this  cU)  into  Equation  (16)  gives 


3(f)  = 2Sg(B-f) 


= 0 


0<  f v B 
f>B 


(19) 


Rather  than  an  RC  filter  with  a response  function  ( 1-t-io-  r- )“ 1 , we 
have  a sampling  interval,  T,  that  is  a box,  with  a response  function  (sin^fT) 
TfT.  Thus,  integrating  over  frequency  to  get  the  fluctuating  output,  Y2  , we 
have 


•B 


Y- 


2S2(B-f)  %pdt 


20 


B JT  f 


i-  B sin(x)  sinu),  , 

ifr"  ~ — JUX 


TI  1 X 


; — v- 

n-T- 
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where  x = aft. 


If  we  let  T get  very  large  relative, to  B,  the  second  term  goes  to 


zero  and  the  integral  of  — -U"  - goes  to  so  that 


?•’  = S~  B/T 

o 


2D 


and  the  relative  error  L 


1 


J 


There  is  a smal 


l b I' ) 


v :: 
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i difference  or  from  the  RC  time  constant  result. 

From  chapter  two,  we  know  that  B is  simply  the  reciprocal  of  the 
maximum  autocorrelation  delay,  1/ t . As  we  shall  see  in  the  next  chapter, 
we  will  average  n autocorrelation  functions  to  get  the  final  result,  so  the 

1 - 1 ' 9 

measuring  time  is  T = nt  . This  gives  a relative  error  of  (—  x nt  ) = 

m & t m 

m 

-1/2 

(n)  ",  and  n is  chosen  to  get  the  desired  accuracy  le.g.  5%  requires  n=400). 

IV.  CORRELATION  PROCEDURE 

Normally,  the  autocorrelation  function  is  obtained  by  sampling  Cn 
points  at  equal  intervals.  Each  of  the  first  n points  is  then  multiplied  by 
the  next  n points  to  get  n x n products.  The  n products  with  the  same  delay 
between  the  two  sampled  points  are  then  added  together  and  divided  by  n to 
get  an  average.  This  provides  one  point  in  an  n-point  autocorrelation  func- 
tion based  on  Equation  ^1^. 

A software  program  was  written  to  perform  this  calculation  and  an 
example  of  the  result  is  shown  in  Figure  2 for  a O.CHc  sine  wave  and  two 
different  amplitudes.  The  autocorrelation  function  of  Figure  Ca  and  the 
Wiener-khintchine  ir.tegraL  or  power  spectrum  in  Figure  Cb  are  both  software 
calculations  performed  on  a Wang  '’COC  desk  calculator.  The  autocorre lat ion 
function  requires  about  eight  minutes  and  power  spectrum  about  thirty  minutes 
when  a COO  point  autocorrelation  function  is  used  to  calculate  a -*0  point 
power  spectrum.  Most  of  the  40  points  in  this  case  are  off  the  scale.  I he 
Wang  machine  was  used  because  the  sampling  hardware  was  readily  available  and 


1 

this  machine  is  inexpensive  enough  to  dedicate  to  a simple  task.  However, 
the  machine  is  limited  in  its  sampling  and  computation  speed.  Faster  machines 
could  be  employed  to  speed  up  the  computation,  but  the  slow  sampling  rate  of 
about  lGOHo  is  general  to  all  but  very  expensive  and  sophisticated  equipment. 

At  the  very  least,  then,  some  sort  of  high-speed  buffer  is  necessary 
to  sample  and  store  the  data  prior  to  transmission  to  the  computer,  diver, 
this  prospect,  it  is  reasonable  to  include  hardwired  computation  in  the  samp- 
ling buffer,  particularly  when  noise  correlation  is  proposed.  In  the  example 
of  Figure  2.  we  had  a signal  which  is  nonstatist ical , thus,  only  one  autocor- 
relation function  is  required.  However,  from  chapters  two  and  three,  we  know 
that  400  autocorrelation  functions,  each  requiring  400  sampled  points,  are 
necessary  to  get  a good  time-averaged  one-decade  noise  spectrum.  If  all  the 
points  are  sampled  and  stored,  this  requires  160,000  words  of  memory.  If  the 
calculations  are  made  after  each  400  point  block  is  sampled,  then  only  a 200 
word  cumulative  memory  for  the  averaged  autocorrelation  function  plus  a 400 
word  memory  for  one  sampled  block  is  required.  However,  eight  minutes  of  com- 
putation would  transpire  between  samples,  greatly  increasing  the  total  sampling 
time  and  causing  problems  of  drift  control.  A faster  machine  could  reduce  the 
computation  time  to  a few  seconds,  but  the  sampling  time  alone  can  be  several 
hours  and  this  would  entail  too  much  use  of  an  expensive  machine. 

In  order  to  avoid  these  problems,  the  concept  of  incomplete  corre- 
iation  can  be  effectively  used.  This  term  describes  a scheme  in  which  the 
first  sampled  point  is  multiplied  by  the  next  n points  to  get  a crude  auto- 
correlation function.  aecause  all  the  points  are  not  correlated  with  each 
other,  incomplete  use  is  made  of  the  available  data  and  more  samples  must  be 

i 

taken.  Only  one  of  the  n ooints  is  correlated,  so  we  use  — of  the  available 

n 

information.  In  our  one  decade  frequency  spectrum  with  a 200  point  autocorre- 
lation function  we  excect  to  use  1/200  of  the  oossible  data. 


Actually,  the  information  loss  is  not  that  severe.  For  perrectly 
bar.d-limited  spectra,  the  Nyquist  criterion  requires  a 20  point  autocorrelation 
function  for  a one  decade  spectrum.  We  increased  that  to  200  to  account  for 
imperfect  band  limiting  and  to  increase  the  resolution  of  the  autocorrelation 
function,  but  the  order  of  magnitude  increase  in  data  gives  nothing  like  a 
factor  of  10  increase  in  information.  Therefore,  the  information  loss  ruotor 
due  to  incomplete  correlation  is  between  20  and  dOO , probably  closer  to  dO  . 

This  is  also  the  increased  time  factor  required  for  a fixed  accuracy  in  a 
modified  Equation  (22). 

In  order  to  verify  this  analysis,  autocorrelation  functions  were 
calculated  over  various  numbers  of  sample  sets  using  a software  simulation  of 
incomplete  correlation.  For  each  number  of  sample  sets  or  total  time  inter- 
val, eight  functions  were  computed  and  a percent  variance  at  particular  fre- 
quencies in  the  computed  spectra  were  calcula' 
limited  to  1.0Hz  and  sampled  at  dOHc.  The  do1 
experimental  results  at  two  frequencies,  whil< 

retical  •'redictions  from  Equation  idd).  Note  that  this  data  lies  generally 
between  the  20  and  200  information  loss  factor  corrections  and  follows  the 
slope  of  these  lines. 

Offsetting  the  increased  time  required  for  sampling  by  the  use  of 
incomplete  correlation  is  the  complete  elimination  of  computation  time. 

This  is  accomplished  by  hardwiring  an  asynchronous  calculator  of  the  auto- 
correlation function  that  takes  place  between  sample  times  up  to  a rate  of 
lOCKHc.  This  is  impossible  to  do  for  complete  correlation  because  of  the 
lengthv  clocked  calculations  required  unless  all  dOP  points  are  calculated 
in  parallel.  Hardwiring  this  parallel  calculation  is  impossible  for  cost  and 
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10  confirm  trie  time  comrans^  n idvantage  or  the  incomplete  uorre.a- 
tion  method,  the  times  for  the  various  alternatives  have  been  plotted  in 


Figure  4 against  the  lowest  frequency  in  a one  decade  spectrum.  '.'he  complete 


correlation  times  were  piottec  tor  the  hang  calculator  ar.u  also  ror 


a HP21MX 


minicomputer  with  an  assumed  computation  speed  100  times  faster  than  the 
Wang.  Each  point  on  these  two  curves  represents  -00  sets  of  data,  each  of  -00 
points,  resulting  in  a 200  point  averaged  autocorrelation  function.  7he  samp- 
ling rate  is  20  times  the  highest  frequency  in  the  one  decade  range,  and  the 
total  time  is  the  sampling  time  plus  the  computation  time. 

The  third  curve  represents  incomplete  correlation  based  on  the  samp- 
ling time  only,  since  all  calculations  are  performed  between  the  samples. 

More  samples  are  required  than  in  the  other  case  due  to  information  less,  so 
30  times  as  many  samples  are  used  to  get  this  curve,  12,000  sets  in  all.  The 
crossover  frequency  for  incomplete  correlation  is  0.06  Ha  for  the  War.g  calcu- 
lator and  6.0  Ha  for  the  minicomputer.  Since  we  are  interested  in  a 0.1  Ha 
and  higher  range  of  frequencies,  the  Wang  calculator  is  clearly  eliminated. 

The  minicomputer  is  eliminated  by  cost  considerations  and  the  6 Hu  corssover 
frequency.  An  additional  argument  is  the  relative  ease  of  including  a hard- 
ware correlator  in  the  required  high  speed  sampling  and  storage  buffer. 

The  block  diagram  of  a high  speed  sampler  and  correlator  is  shown 
in  Figure  5.  The  A-D  converter  digitises  the  data,  passing  it  into  the  latch 
and  multiplier.  The  latch  holds  the  first  point  in  a 200  point  set,  so  that 
it  is  multiplied  by  every  other  point  as  well  as  itself.  These  products  are 
fed  into  the  adder,  where  they  are  added  to  the  cumulative  total  in  the  shift 
register  memory.  The  shift  register  memory  is  200  bits  long,  so  that  the  delay 
between  the  two  multiplied  points  remains  synchronized  with  the  shift  register 
memory.  There  are  several  shift  registers,  latches,  adders,  etc.,  in  parallel 


A clock  pulses  the  A-D  coverter,  the  latch,  the 


to  process  multibit  numbers, 
shift  registers,  and  the  controlling  counters.  One  counter  counts  the  200 
points  in  a data  set,  and  the  other  counter  counts  the  number  of  data  sets.  A 
digital-analog  converter  is  used  to  reconvert  the  data  stored  in  the  shift 
register  for  oscilloscope  display.  The  shirt  register  data  is  also  available 
for  output  to  a computer  for  computing  the  power  spectrum  from  the  autocorrela- 
tion function  at  a later  time.  Note  that  the  mult iplication  and  addition  is 
completely  asynchronous  and  requires  only  about  10c  nanoseconds.  This  means 
that  the  A-D  converter  is  the  limiting  factor  in  determining  sampling  speed. 

At  the  present  time  (January  1976),  eight  bit  converters  with  2 us  conversion 
times  are  available  for  about  $100.  Thus,  we  can  easily  contemplate  200  KHz 
clock  rates. 


V.  QUANTIZATION  AND  SAMPLING  ERROR 

The  number  of  digital  bits  required  for  good  accuracy  should  be 
known  because  it  ran  drastically  affect  the  hardware  cost  and  speed  perform- 
ance. The  speed/cost  ratio  of  the  A-D  converter  is  inversely  proportional 
to  the  number  of  bits  required.  Also,  the  multipliers  and  adders  are  gener- 
ally tour  bit  chips.  The  adders  can  be  wired  in  parallel,  but  eight  bit 
multipliers  are  generally  more  complicated  than  simply  two  four-bit  multipliers 
Additional  logic  and  shift  registers  are  also  required  to  accommodate  more  bits 
Although  superficial  analysis  indicates  that  the  full  scale  accuracy 
of  an  n-bit  oalculation  is  no  bettor  than  1 0 0 / 2 ‘ 1 , the  fact  that  we  are  ana- 
lyzing a randomly  distributed  noise  signal  allow:;  us  to  do  much  better.  Widrow 
has  used  distribution  functions  and  their  transforms  to  indicate  that  this  is 
indeed  so.  A graphical  depiction  of  this  analysis  which  is  similar  to  figure 
1 for  the  Nyquist  criterion  is  shown  in  figure  6.  The  Gaussian  distribution 
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or  the  noise  vs  voltage  is  denoted  bv  : i v ) , where  a is  the  root  mean  square  or 
standard  deviation.  However,  t(iv)  is  the  experimental  distribution  obtained 
from  the  quantized  data,  since  only  data  separated  by  the  bit  size,  h,  is 
available.  F(V)  is  the  transform  of  f(v),  and  F[lV)  is  the  transform  of  t;tv). 

Note  that  F(V)  is  recoverable  from  FilV)  as  lone  as  •*>  — or  h 

lh 

A good  lo  accuracy  criterion  would  require  having  the  overlap  it 

least  three  standard  deviations  down  the  daussian  curve  so  that  — C 

2h  2 no 


t>h 


or  i > — * h.  We  should  also  insist  on  having  at  least  four  standard  devi- 

ations on  either  side  of  the  distribution  center  within  the  full  scale  limits. 
This  will  prevent  clipping  of  the  signal.  A four  bit  machine  has  sixteen 
possible  numbers,  dividing  the  full  scale  into  eight  units  of  width  h on  each 
side  of  zero.  Thus,  we  can  have  a = 2h,  which  would  give  total  accuracy  sig- 
nificantly greater  than  1%. 

Widrow's  use  of  Fourier  transforms  is  very  enlightening,  but  a 
simple  integration  of  the  distribution  function  over  the  quantization  error 
can  give  a good  series  solution  that  converges  rapidly  for  a j h and  also  in- 
dicates how  the  total  error  varies  with  a and  the  true  average.  To  do  this, 
we  define  a function,  ROUNDv,  which  rounds  off  any  v to  the  nearest  available 
bit.  This  results  in  a staircase  function  with  each  step  of  width  h.  The 

normalized  functions,  v/h,  (v/h)"-,  ROUND  v h and  t ROUND  v lO*-  are  plotted 

• . * h h 

against  v/h  in  Figure  7.  The  function  ROUND  v h is  zero  for  - v s v < T and 

has  values  which  are  integral  multiples  of  h.  The  error  at  each  v is  the 

difference  between  this  function  and  the  flv)=v  function.  If  we  integrate 

this  error  over  the  distribution  function,  the  error  resulting  in  the  iverage 

of  many  samples  is  calculated. 

Thus , we  have 


- m. 
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where  E is  the  error  and  V is  the  true  average  or  the  distribution.  The 
second  term  is  simply  the  average  of  v or  V,  giving 


»2tto 


Because  ROUNDv  is  discontinuous , the  integral  must  be  integraged  piecewise 


“ •h(n+lj) 

E - - | nh  exp[ -( v-V )-'  '2o*-]dv  - V 

•'Tito  n-  — » Jh(n-4) 


changing  variables,  we  let  x = (v-V)>2c  so  that 


^ ,'[n+h-V/h Jh/>  To 
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Finally,  we  use 


e~x  dx 


-r-  ert  x ' 


so  that 


A graph  of  this  error  is  plotted  in  figure  8 against  the  average 


voltage,  V.  Both  axes  are  normalized  to  h,  as  is  the  parameter,  a.  for 
a = 0.5h,  the  error  is  already  down  to  0.0023h,  which  is  very  small.  The 
o=0  curve  represents  the  other  extreme,  where  the  total  error  is  identical 
to  the  error  of  a single  sampled  point.  Mathematically  in  this  case,  the 
distribution  function  is  an  impulse  centered  at  V,  so  the  integral  simply 
gives  the  single  point  error  at  V. 

In  our  situation,  we  are  interested  in  noise  power,  so  we  would 
like  to  get  the  error  in  v- . To  do  this,  we  again  integrate  the  distribution 
function  over  the  error,  in  this  case  (R0UNDv)2-v2 . Just  as  in  Equation  (28), 
the  second  term  in  the  integrand  gives  the  true  average  which  is  now 
v*-  = a2  + V2 , and  the  total  result  is 

h2  00  — _ 

E = £ n2{erf[(n+4  - V/h)h/V2o]  - erf[(n-4  - V/h)h/V2o]  - (a2  + V2) 

n=  -°° 

( 29 ) 


A graph  of  this  error  is  given  in  Figure  9 plotted  against  the  normalized 
voltage,  V/h,  with  o as  a parameter.  Note  that  the  error  saturates  for  large 
a at  .083h“  or  h2/12. 

The  factor  h2/12  can  be  understood  by  treating  the  quantization  error 
as  an  additional  noise  source.  Katzenelson'1  has  shown  that  the  input  noise 
signal  and  the  quantization  noise  are  uncorrelated,  so  that  their  autocorrela- 
tion functions  can  be  added.  Also,  if  a is  large,  the  quantization  noise  dis- 


tribution function  is  not  a gaussian 
the  square  of  the  quantization  noise 


, but  a box  of  width  h and  height  When 
voltage,  v2,  is  multiplied  by  the  distri- 
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The  quantization  error  of  the  noise  voltage,  v,  as  a function 
average  voltage. 
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igure  0 


The  quantization  error  of  the  noise  power, 
of  the  average  voltage. 


function 
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bution  function  and  integrated,  we  get  the  autocorrelation  function  of  the 
quantization  noise  at  t=0. 


v0) 


r vr;  dv. 
h Q v 


= h- 


(30) 


Finally,  we  must  determine  how  the  quantization  noise  is  autoccrre- 
lated  for  x>0.  Widrow5  and  Katzenelson°  have  used  the  (1,1)  moment  of  the 
transform  of  the  distribution  function  to  obtain 
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where  p^  and  p are  the  correlation  coefficients  of  the  quantization  noise  and 

the  input  noise  signal  respectively.  This  formula  is  accurate  for  p(x)  close 

h- 

to  unity.  When  o=l,  o.  = 77-  as  we  saw  before.  However,  if  o<h  in  the  expo- 

^ 1- 

nent,  P^  can  be  expected  to  decrease  much  faster  than  p.  This  fact  is  illus- 
trated in  Figure  10.  Since  the  second  point  in  the  autocorrelation  function 
of  the  input  signal  would  normally  have  p<0.99  and  because  we  have  o-2h  in 
our  four  bit  machine,  the  maximum  error  is  about  0.2(h~/12)  for  the  second 
point  and  probably  less  than  0.05(h~/12)  for  the  others. 

Actually,  even  the  tr/12  error  for  the  t=0  point  is  a factor  of  3 
below  the  single  point  error  and  can  be  ignoi'ed  for  2'i  accuracy.  It  is  so 
easily  corrected,  though,  that  it  J.s  worthwhile  to  do  so.  For  extreme  cases, 
the  x>0  error  can  be  corrected  using  Equation  (20)  in  an  iterative  manner. 
Also,  these  errors  are  small  only  for  V near  zero,  such  as  the  range  of  Figure 
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which  is  normal  for  noise  measurements 


However,  strongly  biased  signals 


(V>>0)  ooula  have  a much  larger  error  as  indicated  by  the  trend  of  Figure  '. 

The  preceding  anaiysis  of  this  chapter  assumes  an  infinite  number 
of  points  sampled  so  as  to  obtain  perfect  daussian  or  rectangular  distribu- 
tion functions.  In  reality,  however,  a finite  number  of  sampled  points  yields 
an  inperfect  distribution.  How  much  this  non-ideal  distribution  contributes 
to  error  is  the  auestion  we  must  address  now. 

It  is  well  known  that  if  a random  variable,  v,  is  distributed  with 
mean,  V,  and  variance,  a--,  and  a random  sample  of  sice  n is  taken,  then  the 
sample  mean,  v,  will  be  distributed  with  mean,  V,  and  variance  op,  = j~  n.  The 
t -0  value  of  the  autocorrelation  function  is  o-  tV-,  so  this  is  the  reference 
or  mean.  If  we  want  99%  assurance  of  accuracy,  then  the  integral  over  the 
tail  remainder  in  the  variance  distribution  must  be  .01  or  less.  This  occurs 
at  2.6o_.  A normaliced  error,  x,  then  requires 


l2.6o_)~  = xio4-  t V- 1 
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We  only  tighten  the  restriction  by  letting  V=0,  so 

(2.6c  )-  - xo~ 

x •»  2.6~/n 

6.76  /n  i 33  ^ 

Since  12,000  samples  of  the  autocorrelation  function  are  taken  in  the  incom- 
plete correlation  procedure  and  even  more  in  the  complete  correlation  proced- 
ure , this  finite  sampling  error  is  less  than  6. -f  12,000  = 3.6  x 1C““  = 0.036k. 


This  calculation  is  oversimplified  and  ices  not  account  for  the  very  tricky 
x/0  cases,  but  it  does  illustrate  how  insignif leant  this  error  is  in  our  case 
It  should  be  noted  that  this  sampling  error  occurs  in  both  the  signal  noise 
and  the  quantisation  noise,  but  both  are  very  small. 

VI.  EXPERIMENTAL  RESULTS 

The  correlator  described  in  the  preceding  chapters  was  built  and 
successfully  debugged.  In  its  final  form,  the  instrument  has  several  con- 
venience features  such  as  input  overload  and  output  ready  lights,  adjustable 
clock,  adjustable  output  gain,  adjustable  number  of  samples,  and  an  output 
recirculate  mode  for  oscilloscope  display.  Oscilloscope  photographs  of 
actual  correlator  calculated  autocorrelation  functions  are  shown  in  Figure  11 
for  sinusoidal,  square  wave,  white  noise,  and  Lorentzian  noise  inputs.  The 
upper  trace  in  each  case  is  the  autocorrelation  function  and  the  lower  trace 
is  the  input  signal. 

The  correlator-calculator  system  is  organised  in  a handshaking 
manner  with  two-way  communication.  The  correlator  signals  the  calculator 
when  it  has  completed  its  calculation.  The  calculator  then  clocks  out  the 
stored  autocorrelation  function  into  its  memory,  calculates  the  spectrum, 
plots,  and  prints  the  result.  Because  the  autocorrelation  function  can  be 
stored  indefinitely  and  clocked  out  by  the  calculator  in  segments  of  arbi- 
trary length,  the  demand  on  the  calculator  is  minimal.  This  is  particularly 
important  for  time-sharing  applications  instead  of  a dedicated  calculator. 
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figures  12  and  13  contain  plots  of  the  correlator-calculated  auto- 
correlation function  and  the  subsequent  calculator-calculated  frequency 

spectrum.  The  input  signal  here  is  Lorentzian  noise  with  a — r— r spec- 

lit  t t/r q j 

trum.  There  is  some  point  scatter,  but  a three  point  average  shown  in  Figure 
14  gives  a smooth  curve  with  little  loss  in  frequency  resolution.  In  fact, 
the  small  filter  hump  at  about  GOO  Hz  is  still  retained. 

VII.  CONCLUSION 

We  have  analyzed  the  correlation  probe lm  in  detail,  especially  as 
it  pertains  to  automatic  noise  measurement.  The  various  errors  were  studied 
in  order  to  design  the  most  efficient  system  in  terms  of  speed,  accuracy, 
size,  cost,  and  convenience.  The  error  sources  considered  in  this  study  in- 
clude high  frequency  aliasing,  low  frequency  resolution,  A-D  conversion, 
finite  time,  finite  sampling,  and  quantization.  Software  calculation  of  the 
Wiener-Khintchine  integral  using  this  analysis  shows  that  hardware  correlator 
is  most  effective.  The  correlator  uses  the  incomplete  correlation  method  and 
four  bit  input  resolution.  This  system  combines  the  high  frontend  speed  or  broad- 
band width  and  accuracy  of  a dedicated,  hardwired  correlator  with  the  flexi- 
bility of  a dedicated  calculator  or  time-sharing  computer  which  gives  soft- 
ware calculated,  tabulated  and  graphic  outputs. 
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Figure  12  The  autocorrelation  function  of  a Loreritzian  noise. 
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figure  13  The  power  spectrum  or  the  Lorentr.ian  noise  shown  in 
f i gure  1 2 . 
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